Sequencing of articulatory gestures using cost optimization
نویسندگان
چکیده
Within the framework of articulatory phonology (AP), gestures function as primitives, and their ordering in time is provided by a gestural score. Determining how they should be sequenced in time has been something of a challenge. We modify the task dynamic implementation of AP, by defining tasks to be the desired positions of physically embodied end effectors. This allows us to investigate the optimal sequencing of gestures based on a parametric cost function. Costs evaluated include precision of articulation, articulatory effort, and gesture duration. We find that a simple optimization using these costs results in stable gestural sequences that reproduce several known coarticulatory effects.
منابع مشابه
Sequencing and Optimization Within an Embodied Task Dynamic Model
A model of gestural sequencing in speech is proposed that aspires to producing biologically plausible fluent and efficient movement in generating an utterance. We have previously proposed a modification of the well-known task dynamic implementation of articulatory phonology such that any given articulatory movement can be associated with a quantification of effort (Simko and Cummins, 2010). To ...
متن کاملEvaluation of Juncture Strength using Articulatory Synthesis of Prosodic Gestures and Functional Data Analysis
Prosodic boundary gestures (pi-gestures) (Byrd & Saltzman, J. Phon., 2003) have been introduced to model the local slowing or lengthening of articulatory gestures in the vicinity of phrase boundaries. In this paper, pi-gestures are simulated within the TaDA task dynamics computational model and examined using functional data analysis (FDA) to evaluate articulatory lengthening in terms of underl...
متن کاملMapping between acoustic and articulatory gestures
We propose a method for Acoustic-to-Articulatory Inversion based on acoustic and articulatory ‘gestures’. A definition for these gestures along with a method to segment the measured articulatory trajectories and the acoustic waveform into gestures is suggested. The gestures are parameterized by 2D DCT and 2D-cepstral coefficients respectively. The Acoustic-to-Articulatory Inversion is performed...
متن کاملRobust word recognition using articulatory trajectories and gestures
Articulatory Phonology views speech as an ensemble of constricting events (e.g. narrowing lips, raising tongue tip), gestures, at distinct organs (lips, tongue tip, tongue body, velum, and glottis) along the vocal tract. This study shows that articulatory information in the form of gestures and their output trajectories (tract variable time functions or TVs) can help to improve the performance ...
متن کاملThe Dynamics of Error
We report findings from speech error experiments that challenge particular assumptions about articulatory effort as they have gained widespread currency in recent phonetic and phonological theory. We find that in errors, speakers often add extra gestures that are phonotactically illegal, but crucially create a symmetric frequency pattern. While this increase in number of articulatory events is ...
متن کامل